Dopamine prediction error responses update demand.
نویسندگان
چکیده
According to the law of demand, the quantity demanded for a reward is dependent upon the price; as the price of the reward increases, the quantity demanded decreases (1). Conversely, when the price decreases, the quantity demanded increases. This relationship can be observed at any local bar during “happy hour,” a limited time during which the price of beer is discounted. As happy hour draws to a close, patrons quickly consume pints of beer and order “one more round.” The discounted price increases the quantity demanded of beer. The relationship between price and the quantity demanded is formalized using demand curves. Fluctuations in price cause movement along a demand curve, whereas changes in factors such as subjective value or income shift demand. These shifts result in new demand curves (Fig. 1). Understanding the neural mechanisms that participate in this economic tradeoff has implications in neuroscience, economics, and policy making. In PNAS, Schelp et al. (2) demonstrate that dopamine teaching signals, phasic activity that codes for the differences between received and predicted values, cause changes in the behavioral manifestations of economic demand. Consumers determine demand by calculating the values of rewards they desire, and weighing those values against their income and externally controlled prices. How does the nervous system mediate this transformation from desire to demand? It is likely that neural substrates contributing to this transformation can be found in the reward system. Dopamine neurons respond to rewards and are an ideal candidate to influence consumer demand. These neurons emit action potentials in phasic bursts that code for reward prediction errors, the differences between received and predicted rewards (3, 4), as follows:
منابع مشابه
Dopamine, Inference, and Uncertainty
The hypothesis that the phasic dopamine response reports a reward prediction error has become deeply entrenched. However, dopamine neurons exhibit several notable deviations from this hypothesis. A coherent explanation for these deviations can be obtained by analyzing the dopamine response in terms of Bayesian reinforcement learning. The key idea is that prediction errors are modulated by proba...
متن کاملDopamine prediction error responses integrate subjective value from different reward dimensions.
Prediction error signals enable us to learn through experience. These experiences include economic choices between different rewards that vary along multiple dimensions. Therefore, an ideal way to reinforce economic choice is to encode a prediction error that reflects the subjective value integrated across these reward dimensions. Previous studies demonstrated that dopamine prediction error res...
متن کاملA transient dopamine signal encodes subjective value and causally influences demand in an economic context
The mesolimbic dopamine system is strongly implicated in motivational processes. Currently accepted theories suggest that transient mesolimbic dopamine release events energize reward seeking and encode reward value. During the pursuit of reward, critical associations are formed between the reward and cues that predict its availability. Conditioned by these experiences, dopamine neurons begin to...
متن کاملModel-based predictions for dopamine.
Phasic dopamine responses are thought to encode a prediction-error signal consistent with model-free reinforcement learning theories. However, a number of recent findings highlight the influence of model-based computations on dopamine responses, and suggest that dopamine prediction errors reflect more dimensions of an expected outcome than scalar reward value. Here, we review a selection of the...
متن کاملBOLD Responses to Negative Reward Prediction Errors in Human Habenula
Although positive reward prediction error, a key element in learning that is signaled by dopamine cells, has been extensively studied, little is known about negative reward prediction errors in humans. Detailed animal electrophysiology shows that the habenula, an integrative region involved in many processes including learning, reproduction, and stress responses, also encodes negative reward-re...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Proceedings of the National Academy of Sciences of the United States of America
دوره 114 52 شماره
صفحات -
تاریخ انتشار 2017